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[57] ABSTRACT 

The present invention is directed to providing a method and 
apparatus for enhanced processing of partitioned image data 
in a manner which permits eflScient processing (for example, 
real-time processing) of the image data without sacrificing 
the quality of the reconstructed image. In accordance with 
exemplary embodiments, image data associated with a par- 
titioned frame of input image data is stored along with 
information which identifies relative placement of each 
partitioned subimage within the frame of image data. The 
information is retained during processing of the input frame 
of image data, such that the original image can be recon- 
structed therefrom without the inclusion of holes or artifacts 
due to misalignment of boundaries. Thus, an input frame of 
image data which has been partitioned can be efficient 
transmitted, stored and rendered without concern that qual- 
ity of the reconstructed image will be sacrificed. 

20 Claims, 3 Drawing Sheets 
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METHOD AND APPARATUS FOR 
PARTITIONING AN IMAGE 

BACKGROUND OF THE INVENTION 

1. Field of the lovention ^ 

The present invention relates generally to processing of 
image data used, for exaniple, to represent text, graphics and 
scanned images. More particularly, the invention relates to 
processing of image data by partitioning the image into a 
plurality of subimages. 

2. State of the Art 

Digitized images displayed on scamiers, monitors and 
printers are typically quantized on a pixel-by-pixel basis and 
stored in memory as pixel maps, more commonly referred to 15 
as pixmaps. A pixmap is a two-dimensional array of picture 
elements mapped to locations of the digitized image. 

To provide sufficient color range and fidelity, each pixel is 
typically stored in memory as a set of color coordinates 
which define the pixel's color location in a given color 
space. For example, a pixel is typically represented by its 
red, green and blue color component values, or by its cyan, 
magenta and yellow color component values. The fidelity of 
the color reproduction is a function of the accuracy with 
which each color component is represented. 

Due to the increased volume of data required to represent 
color images, effort has been directed to decreasing the 
memory requirements associated with color data pixmaps to 
provide more efficient transmission and storage of the 
image. A known technique for enhancing processing speed 
is to divide the input frame of image data into a plurality of 
subdivided, or partitioned areas, so that each subdivided area 
can be individually processed. However, a common problem 
encountered when an input frame of image data is divided 
into blocks is that pixels of the subdivided images are not 
properly transformed to an output space wherein the original 
image is to be reconstructed. 

For example, FIG. 3a illustrates an image represented as 
a frame of image data. This frame of image data is shown 
divided into a plurality of subdivided images which can be 
individually processed. By dividing the frame of image data 
to a plurality of subdivided images, memory requirements 
associated with processing components can be reduced since 
only a single subdivided image need be stored in memory at 45 
any given time during processing. 

However, it is often desirable to transform the image 
represented by the input frame of image data in FIG. 3a to 
a different scale or resolution for output (e.g., output on a 
display or printer). Further, it is often desirable thai the 50 
image represented by the frame of input image data in FIG. 
3a be skewed or rotated for subsequent output. For example, 
it may be desirable to scale a 300 pixel by 300 pixel input 
frame of image data to a printer output firame of 1000 pixels 
by 1000 pixels. Because 1000 is not an integer multiple of 55 
300, a direct mapping of each pixel in the input frame to a 
set number of pixels in the output frame is not possible. As 
a result, some pixels in the output frame may be left 
unmapped thereby creating an appearance of holes in an 
output image which is produced using the output image data, go 

In addition, it may be desired to skew or rotate the input 
frame of image data to produce a rotated image at the output 
device. Those skilled in the art will appreciate that when the 
plurality of subimages illustrated in FIG. 3a are skewed or 
rotated, some additional pixel locations in the output frame 65 
of image data will not be mapped to any subimage of the 
input frame of image data. That is, a rectangular subimage 
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which encompasses a 3x3 pixel array of the input frame, 
when skewed or rotated by a fixed angle, will no longer be 
defined by a rectangular pixel array in the output frame. See, 
for example, FIG, 2a wherein an image is represented by a 
plurality of pixels which form a square. However, once the 
image is skewed, it is no longer represented by a plurality of 
pixels which represent a square in the output frame buffer. 
FIG. 2b shows a similar example for plural subimages which 
are skewed. Again, pixels which are not mapped to any of 
the subimages in the input frame of image data will appear 
as boles in the output image when it is displayed or printed. 

Thus, computational errors, such as errors in rounding or 
truncation when an image is transformed, can result in an 
incomplete allocation, or mapping of pixels in an output 
frame of image data among the various subimages of the 
input frame of image data. If the pixel locations in an output 
frame buffer which stores the output image data are not 
accurately mapped to the various subimages of the input 
frame of image data, image artifacts will appear along 
boundaries between subimages when the original image is 
reconstructed, and will be readily apparent to the unaided 
eye. 

A known technique for addressing the inaccuracies asso- 
ciated with processing partitioned image data is to divide the 
input frame of image data into several overlapping subim- 
ages so that gaps between subimages will not occur in the 
output frame buffer. However, such techniques do not 
resolve misalignments of boundary artifacts. For example, 
misalignments between the plurality of subimages in the 
output frame of image data can produce image artifacts due 
to the inaccurate representation of the boundaries between 
subimages. 

Another technique for addressing the inaccuracies of 
transforming partitioned image data into an output frame 
buffer includes mapping the pixel locations between the 
input frame of image data and the output frame of image 
data to avoid boundary misalignments. Mapping techniques 
between an input space associated with the input frame of 
image data and an output space associated with the output 
frame of image data are of two general types: (1) those that 
perform image transformation from an input device space to 
output device space using forward mapping; and (2) those 
that perform image transformation from an input device 
space to an output device space using inverse mapping. 
These latter two techniques are described in a book entitled 
"Digital Image Warping**, by George Wolberg, ISBO-8186- 
8944-7, 1984, pages 42-45, 

Forward mapping generally refers to a mapping from an 
input image space to an output device space by copying each 
input pixel onto the output image in a frame of output image 
data at positions determined by X and Y mapping functions, 
as described for example in the aforementioned Wolbeig 
book. Although forward mapping can efficiently map an 
input frame of image data to an output frame of image data, 
this technique suffers the drawback of having holes in the 
output image when reconstructed. For example, when an 
input image is resampled to produce an output image (e.g., 
scaled and/or rotated), forward mapping cannot accurately 
map every pixel in the output frame of image data to a 
particular pixel of a subimage in the input frame of image 
data. Rather, some pixels in the output image are left 
unmapped to a subimage of the input frame due, for 
example, to the rounding or truncation which occurs when 
the input image is transformed to the output space. 

The inverse mapping technique is performed by comput- 
ing a mapping of every output pixel to the input image. 
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Although inverse mapping guarantees that no holes will 
result in the reconstructed image, this technique suffers the 
drawback of much slower performance because a compu- 
tation must be performed for each pixel in the output frame 
of image data. That is, a computation is used to identify all 5 
pixels in the input frame of image data which are to be 
mapped to that particular output pixel. 

Accordingly, it would be desirable to provide a technique 
for partitioning image data such that the image data can be 
efficiently processed in a manner whereby the reconstructed 
image does not include holes due to misalignment of bound- 
ary artifacts, yet which achieves performance which is equal 
to or better than that associated with conventional tech- 
niques such as forward mapping. 

15 

SUMMARY OF THE INVENHON 

The present invention is directed to providing a method 
and apparatus for enhanced processing of partitioned image 
data in a manner which permits efiBcient processing (for 
example, real-time processing) of the image data without 
sacrificing the quality of the reconstructed image. In accor- 
dance with exemplary embodiments, image data associated 
with a partitioned frame of input image data is stored along 
with information which identifies relative placement of each 
partitioned subimage within the frame of image data. The 
information is retained during processing of the input frame 
of image data, such that the original image can be recon- 
structed therefrom without the inclusion of holes or artifacts 
due to misalignment of boundaries. Thus, an input frame of 
image data which has been partitioned can be efficiently 
transmitted, stored and rendered without concern that qual- 
ity of the reconstructed image will be sacrificed. 

If an image contains significant amounts of data, such as 
with a large image, a high resolution image or an image 
where continuous tone (contone) color is desired, memory 
requirements associated with processing the image data can 
be significantly reduced, since each subimage can be pro- 
cessed individually. Subsequent processing (for example, 
compression of the output frame of data) can also be 
efficiently implemented. By initiating processing of subim- 
ages without having to wait for an entire frame of input 
image data, the rendering of the image can be performed 
during throughput of image data in a pipelined architecture. 
Further, those skilled in the art will appreciate that multiple 
processors can be exploited to operate upon different sub- 
images of a partitioned image, and to thereby further 
enhance overall processing efficiency of the input image 
data without affecting quality of the reconstructed image. 
Exemplary embodiments achieve such advantages using a 
technique which provides performance equal to or better 
than that associated with conventional partitioning 
techniques, such as forward mapping. 

Generally speaking, exemplary embodiments relate to a 
method and apparatus for processing image data comprising 55 
the steps of: receiving a frame of image data; dividing the 
image data into a plurality of non-overlapping subimages; 
and storing each divided subimage with information used to 
identify a relative position of said subimage with respect to 
an original image from which said image data was derived. 50 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and advantages of the present invention will 
become more apparent from the following detailed descrip- 
tion of preferred embodiments when read in conjunction 65 
with the accompanying drawings wherein like elements are 
designated by like numerals and wherein: 
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FIG. 1 illustrates a printing control system which incor- 
porates an exemplary embodiment of the present invention; 

FIGS. 2a and 2b illustrate exemplary image pixels in both 
input and output spaces; 

FIGS. 3a-3c illustrate an image partitioned model and 
reconstructed image model; and 

FIG. 4 illustrates a flow chart of a method for processing 
image data in accordance with an exemplary embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

1. System Overview 

FIG. 1 illustrates an exemplary embodiment of an appa- 
ratus for processing an input frame of image data in accor- 
dance with an exemplary embodiment of the present inven- 
tion. As referenced herein, image data corresponds to data 
obtained from an image that can be digitized for storage in 
a pixmap and subsequently compressed. Image data that is 
processed in accordance with exemplary embodiments of 
the present invention can be digitized image data captured 
through any instrumentation, such as a video camera. 

Image data as referenced herein encompasses scanned 
data as well as non-scanned data. Non-scanned data typi- 
cally includes character glyphs and graphical data, such as 
hand-sketched or computer generated graphics. Those 
skilled in the art will appreciate that image data processed in 
accordance with exemplary embodiments of the present 
invention can also include any combination of scanned and 
non-scanned data. 

As referenced herein, a frame of image data corresponds 
to a preselected group of digitized data, such as the data 
associated with a display screen or a printed sheet. Typically, 
such image data is obtained from or reproduced using a 
scanner device, a monitor or a printing device. However, 
those skilled in the art will appreciate that the image data can 
merely be processed for transfer between two locations (for 
example, between two computers). 

It will be appreciated that exemplary embodiments of the 
present invention can be applied to the processing of image 
data for reproduction using any visual medium. In the case 
of printing, the image will typically be reproduced on 
conventional size paper such as letter size, A4, B5 and legal 
size. However, those skilled in the art will appreciate that the 
present invention can be applied to images of any size which 
are reproduced in any format. 

To facilitate an understanding of the present invention, 
FIG. 1 illustrates a printing system 100 which incorporates 
features of the present invention. The FIG. 1 printing system 
includes a color laser engine 102, such as any commercially 
available color laser marking engine. For purposes of the 
following discussion, the term "color" includes use of mul- 
tiple colors (such as red, green and blue), as well as 
gray-scale printing using varying shades of gray. 

Referring to FIG. 1, an incoming frame of data is directed 
by a processor, represented as printing system controller 106 
having associated memory 104, to a compression/ 
decompression coprocessor 108 (CDC). Because the 
memory required to store an entire frame of image data 
within the printing system 100 is impractical, an entire frame 
of uncompressed data is not stored within the printing 
system 100 at any given time. Rather, a frame buffer stores 
the incoming frame of image data in portions (for example, 
on a row-by-row basis), for sequential processing. As each 
portion of the frame is processed, another portion is fetched 
by the printing system controller. As a result, the entire 
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frame of image data is only stored in the print system 100 in of the frame is retrieved, decompressed and returned to the 

compressed form. frame buffer. The decompressed data which has been 

In accordance with exemplary embodiments, the printing returned to the frame buffer is then overlaid with the newly 

system controller 106 can be a reduced instruction set received image data, after which the superimposed image 

computer (RISC) such as the 33 Megahertz 29030 processor 5 data is recompressed. 

available from Advanced Micro Devices. The printing sys- Those skilled in the art will appreciate that the 

tem controller 106 pre-processes an incoming frame of compression/decompression coprocessor need not be imple- 

image data to: (a) scale the image data to a desired resolu- mented using a separate chip; rather the compression/ 

tion; (b) partition the image data into partitioned blocks of decompression functions can be implemented with any or all 

a predetermined size; (c) resample the image data to ensure lO other functions of the FIG. 1 system in a single ASIC using 

its alignment with the partitions; (d) filter the image data to a single processor. Further, those skilled in the art will 

ensure that each partitioned block contains no more than a appreciate that the compression and decompression func- 

predetermined number of color variations; and (e) create a tions of the FIG. 1 system can be implemented in software 

side information buffer with information acquired during the or hardware. In the exemplary FIG. 1 embodiment, the 

pre-processing that can be used to enhance performance 15 compression functions are implemented using software and 

during subsequent processing. hardware, while the decompression functions are primarily 

In accordance with exemplary embodiments, the com- implemented in hardware, 

pressing of image data includes a step of classifying each Once a frame of image data has been compressed and 

partitioned block based on whether the partitioned block is stored in the compression/decompression coprocessor, it can 

determined to be color variant or determined to be color 20 subsequently be transferred to the printer engine 102 via a 

invariant. This step of classifying can be implemented by system bus 110 and a video interface device (VID) 112. The 

comparing the pixels within a given partitioned block to one video interface device can, for example, be formed as a 

another during the pre-processing to determine whether a separate ASIC chip having a decompression processor to 

given partitioned block is color variant or color invariant. support decompression and half-toning. Alternately, a single 

Once having classified each partitioned block as being either 25 processor can be used to implement the functions of the 

color variant or color invariant, the compression/ controller 106, the coprocessor 108 and video interface 

decompression co-processor 108 can be used to further device 112. The video interface device provides high quality 

compress the data. Those skilled in the art will appreciate reproduction of the original image from its compressed 

that the steps of classifying each partitioned block as being format. 

either color variant or color invariant can be performed by 30 The FIG. 1 system further includes an input/output (I/O) 

the printing system controller 106 as part of the pre- communications device 114. The input/output communica- 

processing (for example, classification information can be tions device can include, for example, built-in networking 

stored in the side information buffer), or can be performed support as well as parallel/serial I/O ports. Further, the I/O 

by the compression/decompression coprocessor 108. communications device can include additional memory as 

The compression/decompression coprocessor 108 can, for 35 well as memory expansion ports. Any conventional I/O 

example, be formed as a monolithic application specific communications features can be used in accordance with the 

integrated circuit (that is, an ASIC chip). However, those present invention, such that the I/O communications device 

skilled in the art will appreciate that the processing imple- need not be described in detail, 

mented by the coprocessor 108 can be performed by the 2. Uncompressed Image Data Format 

same processor used to implement the functions of the 40 An input frame of image data associated with an original 

controller 106. The compression/decompression coproces- image has a given width and length. The number of pixels 

sor compresses the image data included in the partitioned in a given row of a scan line across the width of the frame 

blocks of pixels to substantially reduce the memory require- is set in a horizontal total pixel count register. In accordance 

ments required to store a frame of image data. with exemplary embodiments of the present invention, the 

In accordance with exemplary embodiments, the 4S value set in the horizontal total pixel count register is 

compression/decompression coprocessor compresses the divisible by 4. 

image data within each partitioned block by representing a In a vertical direction, along the length of the frame (and 

block which is determined to include color variations with in the case of printing, along the paper motion direction), the 

less color fidelity than a block which is determined not to number of pixels is set in a vertical total pixel count register, 

include color variations. Further, the compression/ 50 Again, the value set in the vertical total pixel count register 

decompression coprocessor uses memory (that is, any sped- of exemplary embodiments is divisible by 4. 

fied memory) for storing the compressed image data as a In accordance with exemplary embodiments, the user can 

representation of the original image. Alternately, the com- also set the number of bits used to represent each color 

pressed image data can be immediately transmitted from the component for a given pixel to 1, 4 or 8 bits. For example, 

printing system 100 as it is compressed, for external buff- 55 if the user selects 4 color components to define a pixel, with 

ering and decompression. each color component being represented by 8 bits, then each 

In an exemplary embodiment, a decompression engine is pixel would be represented as a 32-bit word (that is, 8 bits 

included within the compression/decompression coproces- for each of the cyan, magenta, yellow and black color 

sor for use during the compression process. Recall that an components). 

entire frame of uncompressed image data is not stored in the 60 In accordance with exemplary embodiments, the color of 

printing system 100 at any given time; rather the entire a pixel can be represented by any number of color 

frame is stored and compressed in sequentially processed components, including 1, 3 or 4 color components. For 

portions. The decompression engine is provided within the example, a four color component representation includes 

compression/decompression coprocessor to accommodate a cyan, magenta, yellow and black color components. For a 

situation where newly received image data is to be super- 65 given appfication, when the number of color components 

imposed on portions of the frame which have been earlier used to represent a given color is set to 1, the color of a pixel 

compressed. In this situation, the earlier compressed portion is defined by the magnitude of a single color component 
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(such as black). When the number of color components is set 
to three, the color components used can be cyan, magenta 
and yellow color components. When the number of color 
components is set to be four, the 4 color components 
mentioned above can be used to define the color of a given 
pixel. 

Where each of four color components in each pixel of a 
pixmap is encoded with 8-bits, a letter-size page having 
approximately 32 million, 600 dots per inch (dpi) color 
pixels, requires approximately 128 Megabytes of memory to 
store the page. Because a memory requirement of 128 
Megabytes per page is cost prohibitive, exemplary embodi- 
ments of the present invention are directed to compressing 
this data using a partitioned input frame of image data. 
3. Preprocessing of Image Data 

As mentioned previously, image data which is received 
for storage in an image data input frame buffer of memory 
104 is preprocessed. The preprocessing can include parti- 
tioning the frame into blocks having a predetermined num- 
ber of pixels. Once partitioned fiuther processing of the 
frame of image data can include: (a) scaling a frame of 
digitized image data to ensure that each partitioned block 
will have the same number of pixels; (b) resampling the 
image data to account for misalignment between the frame 
of image data and partitioned blocks and/or (c) any other 
desired processing of the data. 

In accordance with the exemplary embodiment described 
herein, an input frame 300 of image data is partitioned, in a 
first level of partitioning, into blocks which represent sub- 
images 302, as illusu-ated in FIG. 3a. These subimages can, 
if desired, be further subdivided, in a second level of 
subpartitioning, to form partitioned areas formed as 4-by-4 
pixel arrays within each subimage for purposes of enhancing 
subsequent processing. For example, the partitioned areas of 
each subimage can be compressed in a manner as described 
in commonly assigned U.S. appUcation Ser. No. 08/397,372, 
filed Mar. 2, 1995 (Attorney Docket No. P1481/149), 
entitled "METHOD AND APPARATUS FOR COMPRES- 
SION OF DIGi nZED IMAGE DATA USING VARIABLE 
COLOR FIDELITY" the contents of which are hereby 
incorporated by reference in their entirety. The exact block 
size can be set by the user as a block size field stored in a 
register. 

Those skilled in the art will appreciate that both the 
partitioned subimages and the partitioned blocks can have 
any number of pixels, and that the subimages and blocks can 
be of any desired shape. Alternately, the partitioned subim- 
ages can be considered the subpartitioned blocks if no 
further subdividing is desired. Accordingly, for purposes of 
simplifying the following discussion, only the partitioning 
of an image into subimages will be discussed with respect to 
the subdivided images. Those skilled in the art will appre- 
ciate that features described with respect to the subdivided 
images can be applicable to any one or more levels of 
partitioning. 

In an exemplary embodiment, the subimages are capable 
of being tiled in non-overlapping fashion to encompass the 
entire image. For example, the shape of each partitioned 
subimage need not be square, but can be rectangular, cross- 
shaped, or shaped as described in "Tihngs and Patterns, an 
Introduction", by W. H. Freeman, New York, 1989, ISBN 
0-7167-1998-3, the disclosure of which is hereby incorpo- 
rated by reference. For example, the skewed patterns of 
FIGS. 2a and 2b can be specified as a tile shape for the 
subimages in a frame of image data. 

'^Those skilled in the art will appreciate that such parti- 
tioning is not limited to a single shape, but can be a 



combination of shapes. Further, those skilled in the art will 
appreciate that non-tiled and/or non-overlapped blocks can 

be used at some possible expense to the compressed buffer 
size and/or the integrity of the compressed data relative to 

5 the original image. 

In accordance with exemplary embodiments, enhanced 
processing of partitioned image data is performed in a 
manner which permits efficient processing without sacrific- 
ing the quality of a reconstructed image. In accordance with 

10 exemplary embodiments, the processor 106 of FIG. 1 can be 
used to implement a method for processing image data by 
dividing a frame of received image data into a plurality of 
non-overlapping subimages as illustrated in FIG. 3^. As the 
frame of image data is divided, global information regarding 

15 the overall input frame of image data is retained and stored 
with each of the subimages as represented by the association 
of an image header 304 with each stored subimage in FIG. 
3b. 

Global information can, for example, include information 

20 regarding the transformation matrix for transforming the 
input firame of image data into the output frame of image 
data, size of the image, image resolution and so forth. For 
example, the global information can identify the overall size 
of an image (e.g., 100 pixels by 100 pixels), and an origin 

25 reference location to which all other pixels in the image can 
be correlated. The origin reference location can, in an 
exemplary embodiment, be user specified to correspond 
with the pixel location (0,0) in a two-dimensional space 
(e.g., x-y space) of the input frame buffer, representing the 

30 top left pixel in an image to which all subimages will be 
correlated. The global information of the input frame of 
image data can be stored with each divided subimage so that 
as the image is reconstructed in the output frame of image 
data, as shown by the reconstructed output frame 306 in FIG. 

35 3c, this information is available to enable precise recon- 
struction. Alternately, the global information can be stored in 
a memory location (e.g., look-up table) which is separate 
from the subimage but which is known in advance, or which 
is pointed to by a pointer of the subimage header. Those 

40 skilled in the art will appreciate that the global information 
can be stored in any location which can be identified and 
accessed at the time boundary information is to be used to 
partition the output frame buffer. 
In addition, each subimage can be stored with local 

45 information which represents a relative position of the 
subimage with respect to the original frame of image data 
from which the subimage was derived. The frame of image 
data is divided according to a user-configured number of 
partitions. For example, the user can configure an input 

50 frame of image data corresponding to a 100 pixel by 100 
pixel image into foiu" hundred partitioned subimages of 5 by 
5 pixels. The twenty subimages in the first row will have top 
left pixel locations at locations (0,0); (5,0); (10,0) . . . (95,0), 
respectively, relative to the origin reference of (0,0). Each of 

55 the remaining 19 rows of subimages will be similarly 
correlated to the origin reference location. As with the global 
information, the local information can also be alternately 
stored in a memory location which is separate from the 
subimage, but which is known in advance, or which is 

60 pointed to by a pointer in the subimage header. Those skilled 
in the art will appreciate that the local information can be 
stored in any location which can be identified and accessed 
when boundary information is to be established for a given 
subimage. 

65 The overall geometry information and the relative posi- 
tional information can thus be used to collectively represent 
information which identifies boundaries between subim- 
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ages. Each subimage is associated with header information 
used to identify common attributes regarding overall geom- 
etry of the original image, and which includes information 
that identifies a relative position of each subimage with 
respect to the overall geometry. 

The relative position of each subimage with respect to the 
overall frame of input data, represented as a coordinate 
location of the top left pixel for each subimage in the above 
example, can be precomputed and stored at the time the 
original frame of input image data is subdivided into the 
plurality of subimages. In addition to a reference coordinate 
location, the relative position identified in the header of each 
subimage can also include information that identifies bound- 
aries between the subimage and all bordering subimages. 
This boundary information can, for example, include the 
local header information which identifies the relative posi- 
tion of each bordering subimage, and/or information which 
identifies the boundary pixel locations themselves. 
Alternately, the boundary information can be precomputed 
in the output firame buffer based on global information which 
identifies how the input image was partitioned. As men- 
tioned previously, all or any portion, of such information can 
be stored directly in the header, or can be stored in the header 
as a pointer to some other location in memory. 

Once the global and relative positional information has 
been calculated and stored as a header for all subimages in 
the input frame of image data, the frame of image data can 
be processed into subimage locations in memory. In accor- 
dance with exemplary embodiments, the entire firame of 
input image data can be stored and processed into subimage 
data, and then afterwards, mapped to the output frame buffer. 
Altemately, as subimage data is received, it can be processed 
to the output frame buffer without waiting for receipt of 
image data with respect to remaining subimages, and with- 
out concern that overall degradation in quality of an image 
associated with the output frame of image data will occur. 

More particularly, as the image data associated with one 
or more subimages is being received by the input frame 
buffer, earher stored image data can be mapped to the output 
frame buffer. Boundary information of the output frame 
buffer can be obtained from, or computed on the basis of, the 
subimage header information. Altemately, the boundary 
information can be incorporated into a bit map which is 
constructed from the header information and which identi- 
fies pixels in the input space that correspond to boimdaries 
between subimages. For example, where boimdaries in the 
output frame buffer are to be computed, an equation asso- 
ciated with the transformation matrix can be used to identify 
where the boundaries occur. 

In the example above, where the transformation matrix 
specifies a scaling of the input image frame of data by an 
irrational number of V5, reference locations of various 
subimages relative to the origin reference location would 
include irrational pixel locations. That is, the reference 
position for each of the subimages in the first row of an 
output frame buffer would be at pixel locations of (0,0); 
(11.18,0); . . . (212.42,0). Of course, no pixel locations can 
be mapped to irrational locations in the output ft-ame buffer. 
It is an inability of conventional forward mapping tech- 
niques to effectively deal with these boundary situations that 
results in holes in the output image. However, in accordance 
with exemplary embodiments, the boundaries for each sub- 
image are mapped in advance to pixel locations which can 
be identified using the header information. 

More particularly, when the first subimage of image data 
is being processed, the boundary between the first subimage 
and the second subimage in the output image is either 
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acquired from memory or precomputed using information in 
the header. An irrational boundary is, in an exemplary 
embodiment, truncated to a rational number. Thus, for the 
first subimage, the boundary between the first and second 

5 subimages is (11.18,0), and would be truncated to a pixel 
location of 11. Similar boundary processing can be per- 
formed for other subimages adjacent the first subimage. For 
example, the boundary of the first subimage in the first row 
with respect to the first image in the second row, located at 

10 reference location (0,11.18), would also be truncated. Pixels 
of the first subimage in the input frame of image data can 
then be forward mapped to the pixel locations in the output 
fi'ame of image data to create an 11x11 subimage (pixel 
positions 0-*10 for both x and y directions) in the output 

15 frame buffer. 

To process the second subimage of input data, the header 
information for the second subimage is retrieved from 
memory. Recall that the second subimage was referenced to 
the origin with the header (5,0) in the input frame of image 

20 data. Accordingly, when the value of is scaled using the 
transformation matrix value of V5, it is immediately recog- 
nized that the irrational number of 11.18, representing the 
boundary between the first and second subimages, would 
have been truncated. 

25 As a result, the second subimage is mapped from the pixel 
location 11 to the boundary between the second and third 
subimages. The boundary between the second and third 
subimages can be determined in the same manner used to 
determine the boundary between the first and second sub- 

30 images. This boundary is represented by the pixel location 
which corresponds to 10 in the input frame of image data, 
scaled by the factor of V5, to a pixel location of (22.36,0) in 
the output frame. Because this is an irrational number, the 
second subimage can be mapped as a subimage having 11 

35 columns of image data in the output frame (from location 11 
to 21). 

The foregoing process can be repeated, using relative 
positions of the subimages with respect to one another and 
with respect to the origin reference location to identify 

40 boundary locations in the output frame of data. Complete 
mapping of all pixels in the output frame buffer, up to the 
boundaries, can be realized. Because boundaries between 
subimages can be accurately precomputed and placed in the 
output frame buffer using the exemplary embodiments of the 

45 present invention, an accurate forward mapping of pixels in 
each subimage is achieved. 

Referring to FIG. 4, a flow chart representing an exem- 
plary method for implementing the present invention is set 
forth. In block 402, a processing of a frame of input image 

50 data is initiated. As represented in block 404, when an input 
frame of image data is received, global information is 
included to identify characteristics of the input image, such 
as the transformation matrix, image resolution, size of the 
image, and an output location of the frame buffer. When this 

55 data is received, a processor 106 establishes a global origin 
reference location for the image. As described previously, 
this origin can, for example, be a pixel location (0,0) in the 
input frame buffer. The establishment of a global origin is 
represented by the block 406 in FIG. 4. 

60 After establishing a global origin, the processor further 
divides the input image into subimages based on user- 
configured specifications to derive the relative positional 
information, including boundary information, as local infor- 
mation. In the above example, a 100 pixel by 100 pixel 

65 image was partitioned into subimages of 5 pixels by 5 pixels, 
with boundary information being stored in a memory asso- 
ciated with the input space of the input frame buffer. 
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In block 410, the processor renders Ihe input frame of 
image data by first generating an image header in response 
to the global origin and relative positional information of 
each subimage based on the partitioning. The global infor- 
mation and relative positional information, are then stored 5 
with the subimage data as represented by block 410. 

Once the header information and subimage data have 
been stored for at least one subimage, boundary information 
can be used to determine boundaries in a transformed image 
space, as represented by block 412. The boundaries of the 10 
transformed image space can be accessed from header 
information, or can be precomputed based on header infor- 
mation for use in the transformed image space. In the above 
example, the transformed image space is the output frame 
bufifer. Each pixel of the subimage can then be forward 15 
mapped to the output image space using the transformation 
matrix of the global information, as represented by block 
414. 

As mentioned previously, exemplary embodiments of the 
present invention provide forward mapping of image data 20 
for each subimage as it is received in the input frame buffer. 
This forward mapping of image data can be performed after 
the boundaries associated with the subimage have been 
determined for the output space. As represented by decision 
block 416, once a given subimage has been stored in the 25 
output frame buffer, a subsequent subimage can be 
processed, until the entire input frame of image data has 
been processed, as indicated by block 418. Alternately, as 
mentioned previously, multiple processors can be used to 
transform sub images from the input frame buffer to the 3o 
output frame buffer in parallel. 

While the example described with respect to FIG. 4 uses 
a computation of boundaries in the output frame buffer 
which permits accurate forward mapping of the subimage 
data, those skilled in the art will appreciate that the invention 35 
is not so limited. For example, boundary information can be 
stored as a bit map as described above. In accordance with 
exemplary embodiments, the bit map can be formed using 
the transformation matrix information to thereby identify the 
specific mapping of the pixels from the input frame to the 40 
output frame on a pixel by pixel basis. Exact pixel locations 
in the output frame buffer which correspond to boundaries 
can be identified for the entire frame of image data and 
stored in bit map locations which are indexed by the 
subimage header information. Alternately, to save memory, 45 
a bit map can be created for a given subimage at the time the 
subimage is being transformed into the output frame buffer 
space using header information. Afterwards, each pixel of 
the input frame buffer can be mapped to the output frame 
buffer using the bit map. 50 

In summary, the image header information is received and 
processed, during rendering, before the actual image data 
associated with the subimage. This information is used to 
transform each subimage into an output device space, and to 
precompute the pixels in the output frame which correspond 55 
to the geometrical shape and relative position of the trans- 
formed subimage. As a result, all pixel locations in the 
output frame buffer associated with a given subimage can be 
mapped to pixels of the input subimage. This process can be 
repeated for each divided subimage until the entire frame of 60 
image data is reconstructed in the output device space. 

Those skilled in the art will appreciate a transformation 
matrix can perform any of a variety of processes on the 
frame of input data. For example, the transformation matrix 
can include scaling for magnifying or reducing the scale of 65 
the frame of input data to that of a user specified output 
device. In addition, the transformation matrix from the input 
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device space to the output device space can include rotation 
and/or shear terms. 

In accordance with exemplary embodiments, wherein 
subimage information is stored with global information and 
relative placement information, enhanced processing of the 
input frame of image data can be performed on a subimage- 
by-subimage basis to an output device space without con- 
cern that quality of the reconstructed image in the output 
device space will be sacrificed. As a result, exemplary 
embodiments of the present invention can implement a 
transformation of a frame of input image data to a frame of 
output image data using a forward mapping from the input 
device space to the output device space without concern that 
the reconstructed image will include holes or boundary 
artifacts. The quality previously only associated with con- 
ventional inverse mapping techniques can therefore be 
achieved with a performance comparable to or better than 
that associated with conventional forward mapping tech- 
niques. 

Those skilled in the art will appreciate that exemplary 
embodiments of the present invention can be embodied as 
software which can be used in conjunction with a processor, 
such as processor 106 of FIG. 1. For example, exemplary 
embodiments of the present invention can be implemented 
as a computer readable medium which, in response to receipt 
of a frame of input image data, divides the image data into 
a plurality of non-overlapping subimages, and stores each 
divided subimage with information used to identify a rela- 
tive position of the subimage with respect to an original 
image from which the frame of input image data was 
derived. 

It will also be appreciated that scaling, as described 
above, can be implemented in any known fashion. For 
example, scaling can be implemented using pixel replication 
as described by Dale A. Schumacher in chapter 4 ("Fast 
Anamorphic Image Scaling") of the book entitled Graphic 
Gems II; Arvo, James; San Diego: Academic Press, Inc. 
1991, the disclosure of which is hereby incorporated by 
reference. It may be that a frame of image data has been 
generated at a resolution of 72 dots per inch. Using pixel 
replication, the image data can be scaled up to 150 dots per 
inch for subsequent transfer to the compression/ 
decompression coprocessor. Alternately, the input image 
data for a given subimage can be expanded to a size greater 
than an expected size of the transformed image in the output 
frame buffer, and then cut back in the output frame buffer to 
conform with the boundaries of the subimage in the output 
frame buffer. 

Those skilled in the art will appreciate that any scaling 
techniques can be used in accordance with exemplary 
embodiments of the present invention. Such scaling tech- 
niques can be used to either scale up or scale down an input 
frame of image data to any user selected resolution. 

Further, those skilled in the art will appreciate that once 
partitioning of the input frame of image data has been 
performed and all headers created, any desired preprocess- 
ing of the frame of image data can be performed as part of 
the transformation. As mentioned previously, the prepro- 
cessing can include, for example, a resampling to match the 
input frame of image data to characteristics of an output 
device space. 

Using exemplary input image processing techniques as 
described above, resampling of the frame of image data can 
be performed without affecting quality of an input image. 
Resampling can be included as part of the transformation 
matrix for producing the output frame of image data from 
the input frame of image data. When using resampling 
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techniques, relative placement of subimages with respect to considered in all respects to be illustrative and not restricted, 

the overall frame of input data is retained in memory such The scope of the invention is indicated by the appended 

that subimages in the output frame of image data can be claims rather than the foregoing description and all changes 

properly placed and boundaries between subimages accu- that come within the meaning and range and equivalence 

rately located. 5 thereof are intended to be embraced therein. 

In accordance with exemplary embodiments, a frame of What is claimed is: 

image data is resampled when the center of a predefined 1- ^ method for transforming an image from a first space 

pixel block does not align with the center of a partitioned ^ ^"'^^ ^P*^' comprising the steps of: 

block. For example, it is possible that an incoming frame of partitioning he image into a plurality of non-overlapping 

image data is ah-eady at the desired resolution, such that 10 subimages; 

scaUng of the data is not necessary. However, the image data determining position information that identifies a relative 

may not be aUgned with the preselected partitions of the placement of each subimage withm the image in the 

memory where the uncompressed is stored (for example, the space, 

frame buETer) using the position information to determine boundaries 

For example, the image data may be such that the fiist 15 between the subimages in the second space; and 
partitioned block of pixels in the frame buffer is only half forward noapping the image to all pixels within the 
full of data (that is, either the first two rows or the first two boundaries in the second space by independently trans- 
columns of a partitioned block contain no image data). In forming each subimage to its corresponding boundaries 
this case, the image data included within the pixel block is io the second space, wherein for each subimage the 
resampled such that the center of the resampled data is 20 boundaries between the subimage and adjacent subim- 
repositioned in alignment with the center of a partitioned ages in the second space are determined before trans- 
block. This repositioning can be achieved by any conven- forming the subimage. 

tional resampling technique. For example, resamphng can 2. The method of claim 1, wherein each subimage is 

be achieved using spatial filtering, nearest neighbor filtering, mapped to all pixels in the second space that are within ones 

bi-linear interpolation, bi-cubic interpolation and so forth, 25 of the boundaries in the second space that separate the 

without concern that the reconstructed image wiU have subimage from adjacent subimages. 

degraded quality. ^- method of claim 1, wherein transforming the 

Once preprocessing of the image data has been subimages includes at least one of rotating, skewing, 

completed, those skilled in the art wiU appreciate that the scaHng, and translating each subimage. 

partitioned output frame of image data can be subsequently 3o 4. The method of claim 3, wherein transforming the 

processed in any way. For example, once partitioned, the subimages includes rotating each subimage. 

output frame of image data can be compressed for storage 5. The method of claim 1, further comprising the steps of 

and then later reconstructed from its compressed form. compressing and decompressing the subimages. 

Where data is to be compressed, such compression and 6- Th« method of claim 1, wherein the subimages are 

subsequent decompression can be performed in accordance 35 sequentially transformed. 

with exemplary embodiments of the described in commonly 7. The method of claim 1, wherein at least some of the 

assigned U.S. application Ser. No. 08/397,372. subimages are simultaneously transformed using multiple 

Exemplary embodiments of the present invention are processes, 

directed to using a base resolution of 600 dots per inch, with method of claim 1, wherein the position informa- 

each pixel including four color components of cyan, 40 lio" includes positions of the subimages in the first space 

magenta, yellow and black. Each such color component, in with respect to one another. 

exemplary embodiments, is one of 256 values. An entire ^ The method of claim 1, wherein the position informa- 

pixmap, in accordance with exemplary embodiments is tion includes positions of the subimages with respect to an 

partitioned into non-overlapping blocks having a 4-by-4 origi° reference location in the image, 

pixel configuration. Thus, each partitioned block has a 45 1®- The method of claim 1, wherein the position infor- 

resolution of 150 dots per inch. mation includes an overall size of the image. 

While the foregoing has set forth exemplary embodiments H- The method of claim 1, wherein the position infor- 

of the present invention, those skilled in the art will appre- mation identifies boundaries between each subimage and all 

ciate that these examples are by way of illustration only. For adjacent subimages in the first space, 

example, while exemplary embodiments have been 50 12. The method of claim 1, wherein the image is a 

described in connection with pixmaps used with an output subimage of another image. 

printing device, those skilled in the art will appreciate that 13. The method of claim 1, wherein the position infor- 

techniques of the present invention are also suitable for the nation is determined when the image is partitioned, 

reduction of information transmitted between computers, or 14. The method of clainn 1, wherein the position infor- 

between a computer and an input device such as a scanner, 55 mation for each subimage is stored with the subimage. 

or between a computer and an output device (such as a 15. The method of claim 1, wherein the boundaries in the 

printer). second space arc determined by transforming boundaries 

Further, those skilled in the art will appreciate that the between the subimages in the first space, 

partitioned blocks described above can be of any dimension. 16- The method of claim 1, further comprising the steps 

Further, the partitioning can be adaptive and dynamic, even 60 

within a given frame of image data, with the only require- expanding image data for at least one of the subimages in 

ment being that dimensional information be made known to the first space to a size greater than an expected size of 

the decompression process. the corresponding transformed subimage in the second 

It will be appreciated by those skilled in the art that the space; 

present invention can be embodied in other specific forms 65 and cutting back the expanded image data to conform 

without departing from the spirit or essential characteristics with the boundaries of the corresponding transformed 

thereof. The presently disclosed embodiments are therefore subimage in the second space. 
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17. The method of claim 1, wherein the position infor- 
mation is common among the subimages. 

18. A method for processing image data, comprising the 
steps of: 

receiving a frame of input image data; 

dividing the frame of input image data into a plurality of 

non-overlapping subimages in an input space; 
storing boundary information for each of the plurality of 

non-overlapping subimages; 
transforming the boundary information to an output 

space; and 

for each subimage, independently transforming the sub- 
image to all pixels in the output space within bound- 
aries defined by the transformed boundary information 
of the subimage, after transforming the boundary infor- 
mation of the subimage to the output space. 

19. A computer readable medium containing program 
instructions for: 

receiving a frame of input image data; 

dividing the frame of input image data into a plurality of 

non-overlapping subimages in an input space; 
storing boundary information for each of the plurality of 

non-overlapping subimages; 
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transforming the boundary information to an output 
space; and 

for each subimage, independently transforming the sub- 
image to all pixels in the output space within bound- 
aries defined by the transformed boundary information 
of the subimage, after transforming the boundary infor- 
mation of the subimage to the output space. 

20. Apparatus for processing image data comprising: 
] means for receiving a frame of input image data; 

means for dividing the frame of input image data into a 
plurality of non-overlapping subimages in an input 
space; 

means for storing boundary information for each of the 
' plurality of non-overlapping subimages; 

means for transforming the boundary information to an 
output space, and for each subimage, independently 
transforming the subimage to all pixels in the output 
^ space within boundaries defined by the transformed 
boundary mformation of the subimage after transform- 
ing the boundary information of the subimage to the 
output space. 

* * ♦ 1^ * 
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